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ABSTRACT 

In this paper correspondence between experimental data for 
packet delay and two theoretical types of distribution is in- 
vestigated. Calculations have shown that the exponential 
distribution describes the data on network delay better, than 
truncated normal distribution. Precision experimental data 
to within microseconds are gathered by means of the RIPE 
Test Box. In addition to exact measurements the data gath- 
ered by means of the utility ping has been parsed that has 
not changed the main result. As a result, the equation for an 
exponential distribution, in the best way describing process 
of packet delay in a TCP/IP based network is written. The 
search algorithm for key parameters as for normal, and an 
exponential distribution is resulted. 

Categories and Subject Descriptors 

1.2.8 [ARTIFICIAL INTELLIGENCE]: Problem Solv- 
ing, Control Methods, and Search — Control theory; C.2.5 
[COMPUTER-COMMUNICATION NETWORKS] : 

Local and Wide- Area Networks — Internet (e.g., TCP/IP) 

Keywords 

exponential distribution for network delay, truncated normal 
distribution, expression for cumulative distribution function, 
RIPE Test Box, parameters for delay distribution 

1. INTRODUCTION 

The special area of the control theory, named networked 
control systems in which transfers as environment of operat- 
ing signals were used computer networks, has arisen in the 
late nineties of the XX-th century [T6 . Originally, as the 
network environment of control systems local networks [8] 
which differ high-speed data transfer and in the minimum 
percent of packet loss were used. 
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Framing of criteria of stability for networked control systems 
in which as the handle environment the global network In- 
ternet is used, is extremely complicated because of random 
character of distribution of packet delay and their big ab- 
solute values |10[ |14| |15] . Non-use of knowledge of network 
processes, including measurement methods of an available 
bandwidth, knowledge of types of distribution of packet de- 
lay, methods on compensation of packet losses is an obvious 
obstacle in path of development of networked control sys- 
tems. 

However till now, results of the advanced network researches 
are not used in the control theory, no less than algorithms 
on their basis are not created. The present project assumes 
introduction of new network decisions in networked control 
systems. 

For the decision of problems of the networked control sys- 
tems on the basis of stack TCP/IP it is more convenient 
to use the process approach to the control theory, based on 
idea of existence of some universal functions of control. The 
purpose of our research is the finding of these function for 
network components. In the modern theory of computer 
networks there were many utilities working with a network 
delay, there is a progress in studying and modelling of trans- 
miting of packages. Our problem consists in trying to de- 
scribe process of a network delay of management packages 
and to show ways of practical calculation of all parametres 
entering into corresponding distribution functions [9]. 

By transmission of control signals through TCP/IP etwork, 
the separate packages of the controlling data flow transfer- 
ring the information, are supplied non-uniformly, and the 
part of packages in general is lost by transmission on a net- 
work and does not reach a target. For rise of efficiency of 
control algorithms it is necessary to reduce to a minimum of 
packets delay and their variation, and also percent of packet 
loss. Similar algorithms are used for transmission voice and 
video streams, in grid systems, at control of robust systems, 
in network computer games, etc. 

At first it would be desirable to result the brightest research 
on a distribution type for network delay. To understand, 
about what there is a speech in described papers, will give 
definitions of notations used in them: 



• Round-trip time (RTT) time is the time required for a 
packet to travel from the testing host to a the remote 
computer that receives the packet and retransmits it 
back to the source. 

• The One-Way Delay (OWD) value is calculated be- 
tween two synchronized points A and B of an IP net- 
work, and it is the time in seconds that a packet spends 
in travelling across the IP network from A to B. 

In particular, Elteto and Molnar [6] have spent measure- 
ments of round-trip delay in in the Ericsson Corporate Net- 
work, complex analysis of the received data has allowed to 
build the supposition about distribution type for network 
delay. The main finding of their research is that the round- 
trip delay can be well approximated by a truncated normal 
distribution. 



Konstantina Papagiannaki et al 11 in the research have 



measured and have analyzed packet delay between two adja- 
cent routers in the core network. On the basis of the received 
measurements, they have made the supposition about the 
factors influencing occurrence of delay, and very big delays 
which cannot be explained in the way of batch processing in 
routers on algorithm FIFO have been noticed. 

Recently, fulfilling a series of operations on measurement of 
an available bandwidth |12| , we have installed that for a 
type definition of delay distribution we should research only 
a variable part of delay while its most part remains constant. 
This fact also has served as a starting point of our operation. 

2. PREMISES FOR MODEL 

In 1999 Downey [5] for the first time has detected linear de- 
pendence of the minimum possible round trip time on the 
size of transferred packets. In 2004 precise experiments by 
Choi et al [l] proved that the minimum fixed delay com- 
ponent D fixed (W) for a packet of size W is a linear (or 
precisely, an affine) function of its size, 



D f ixed ^ = w J2 i/ Ci + ]T Si 



(1) 



where Ci is each link of capacity of h hops and Si is prop- 
agation delay. To validate this assumption, they check the 
minimum delay of packets of the same size for three path, 
and plot the minimum delay against the packet size. 

Let D(W) represents the point-to-point delay of a packet. 
Here we refer to it as the minimum path transit time for the 
given packet size W, denoted by D fixed (W) = min D{W). 
With the fixed delay component D flxed (W) identified, we 
can now substract it from the point-to-point delay of each 
packet to study the variable delay component d var . The 
variable delay component of the packet, d var , is given by 



The value D m i„ is related to the distance between the sites 
(i.e. propagation delay) and per-packet router processing 
time at each hop along the path between the sites [5J [3]. 
This value represents as the minimum delay D m in for which 
the very small package can be transmitted on a network from 
one point in another. 



The minimal delay [12] of datagram transmission D n 
be calculated as 



W 2 Di - W1D2 
W 2 - Wi 



may 



(5) 



This value as well as the methods of its measurement has a 
important significance in applied tasks of control theory [16] . 
The second significant question of networking control theory 
is the distribution type for variable delay component d var 
which should be studied. To know the expression for this 
parameter we may easy calculate the duration of buffer for 
streaming aplication on receiving side. 



3. EXPERIMENTAL SEARCH 

To determine distribution type for a variable delay compo- 
nent d var we should gather enough considerable quantity of 
measurements between various hosts in the Internet, made 
with a precise accuracy. The basic problem of experimental 
testing is the precise of delay measurements that is neces- 
sary for accurate result. The exact metering demands micro 
second precision for delay measurements; we are reaching 
such accuracy with help of RIPE Test Box mechanism [7] 
|13| . In order to prepare the experiments three Test Boxes 
have been installed in Moscow, Samara and Rostov on Don 
during 2006-2008 years in framework of RFBR grant 06- 
07-89074. Each RIPE Test Box represents a server under 
management of an FreeBSD operating system with the GPS 
receiver connected to it. 

Characteristic times of investigated processes (a packet de- 
lay, jitter) have the order from 10 ms to 1 sec, therefore is 
quite enough accuracy of system hours of a RIPE Test Box 
for their reliable measurement. At the first stage experiment 
between tt01.ripe.net (RIPE NCC at AMS-IX, Amsterdam), 
ttl43.ripe.net (Samara, SSAU), ttl7.ripe.net (Bolonia) and 
tt74.ripe.net (Melburn) have been made which included pre- 
cision measurement of packet delay with accuracy 2-12 /is. 
Testing results are available in telnet to corresponding RIPE 
Test Box on port 9142. It is important to come and write 
down simultaneously the data on both ends of the investi- 
gated channel. 

On the basis of the received data set it is easy to construct 
a cumulative distribution function for network delay D: 



D(W) = D fzxed (W) + d var 



(2) 



F(D) = P(x < D) 



(6) 



Computed minimal delay D ftxed (W) is 

D f*~*(W) = Dmin + W/C, 
where C is end-to-end capacity and 

D min = Km D flxed {W) 

W-t0 



For initial comparison truncated normal and exponential 

(3) distributions have been chosen, expressions for which are 
written down. 

(4) For truncated normal distribution it is possible to select fol- 



N 


host 


W (bytes) 






1 


bolonia 
tt01->ttl7 


100 


0.76 


0.97 


2 


samara 
tt01->ttl43 


100 


0.87 


0.98 


3 


samara 
tt01->ttl43 


1024 


0.99 


0.99 


4 


melburn 
tt01->tt74 


100 


0.66 


0.97 



Table 1: Precise measurements 



N 


host 


W (bytes) 






1 


AIST 










New Zeland 


32 


0.94 


0.95 


2 


Volgatelecom 










Australia 


32 


0.96 


0.98 


3 


SSAU 










Melburn 


64 


0.66 


0.97 


4 


Infolada 










Athens 


32 


0.98 


0.98 



Table 2: ping measurements 



lowing approximation: 
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D > D„ 



where 



(7) 



(8) 



is the difference between average network delay D av (W) = 
E[D(W)] and minimum delay D min (W). 

It is necessary to mark that all statistics was gathered by 
us for the fixed size of a packets W. By default for RIPE 
Test Box it equals to 100 bytes. Later we update a cumula- 
tive distribution function F(D, W) taking into account the 
packets size W. 

The alternative type of allocation which will be checked on 
correspondence is an exponential distribution, expression for 
which is written below. 

/; ' /; (9) 

1 - exp {-X(D - Dmin)} , D > D min 



where 



A= l/(D av -Dr, 



(10) 



is reciprocal to the difference between average network delay 
D av (W) = E[D(W)} and minimum delay D min (W). 

For check of conformity to distribution type two methods 
will be used: calculation of Pearson correlation coefficient 
and a graphic method. We will designate as K nor correla- 
tion coefficient between experimental and normal distribu- 
tions then K exp is correlation coefficient between experimen- 
tal and exponential distributions. 

The data obtained by us is shown in Table [l] where the 
column host corresponds to a direction between two RIPE 
Test Boxes, and the column W specifies in the size of a 
testing packet. 

Except correlation coefficients it is possible to compare and 
graphics representation of cumulative distribution functions, 
representing all three functions on one schedule. On the uni- 
form graphics (see Figure [TJ red color selects an experimen- 
tal curve, blue color corresponds to normal allocation. In 
black colour the exponential distribution is painted. 



All experiments resulted above testify that the best type 
of distribution describing packet delay in a global network, 
represents an exponential distribution. Thus, as have shown 
our researches, the random variable of packet delay between 
two network points is arranged on an exponential low with 
the parameter calculated from experimental values under 
the Equation |To|). 



4. THE ELEMENTARY CHECK 

However, it is not each investigator who is engaged in the 
control theory, has at the instruction the precision measur- 
ing system, similarly RIPE Test Boxes. Therefore in this 
part it would be desirable to test delay distributions, lean- 
ing against the data of well-known utilities which are not 
demanding the expensive equipment. 

For testing it is possible to use the utility ping as it is the 
most widespread and readily available resource for connec- 
tion quality check in TCP/IP networks. Let's mark only 
that this utility measures round-trip time, instead of one way 
delay, correspondence between these values approximately 
equally OWD « RTT/2. 

We wish to be convinced that the data received ping, is exact 
enough that it was possible to judge delay distribution. Us- 
ing the utilityping, we have tested connection between points 
AIST - New Zealand (tt47.ripe.net), Volgatelekom - Aus- 
tralia (tt74.ripe.net) and SSAU-Melbourn (tt74.ripe.net). As 
remote hosts were used servers of RIPE measurement sys- 
tem, AIST, Volgatelecom and SSAU is local internet Ser- 
vice Providers from Samara region, Russia. Processing the 
obtained data on the above described algorithm, we have 
received the results presented in the Table [2] 

The evident illustration is resulted in definition of distribu- 
tion type in Figure [2] 

It should be noted that the utility ping allows finding auto- 
matically values of variables D av and D m i„ (see Eqns. |7f 
and (|9|) which completely define the distribution form, both 
normal and exponential types. It is enough to give sequence 
from 10 packets to obtain the given values with a split-hair 
accuracy, sufficient for the description of processes of the 
control theory. 

5. DISTRIBUTION TYPE FOR DELAY 

In real the Internet processes the size of transferred pack- 
ages can vary, therefore the cumulative distribution function 
should be updated. For each size of a packet W there is the 
minimum time D flxed (W) defined by the equation S. 
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Figure 1: Experimental (red), normal (blue) and exponential (black) cumulative distribution function, precise 
testing 




Figure 2: Experimental (red), normal (blue) and exponential (black) cumulative distribution function, ping 
testing 



Then, the final cumulative distribution function F(D, W) is 

I" 0, D < Dmin + W/C 

F(D, W) = l 1 - exp {-X(D - D min - W/C)} , (11) 
{ D > D mm + W/C 

where 

A = l/(D av — D m in) (12) 

is reciprocal to the difference between average network delay 
D av {W) = E[£>(W)] and minimum delay D min (W) and C 
is end-to-end capacity. 

It is necessary to mark that control signals are told by pack- 
ets of the different size that brings the additional contribu- 
tion to a delay variation (network jitter j). And, the less 
available bandwidth of end-to-end connectivity, the network 
jitter will be stronger HI. Therefore, the best the controlling 
algorithm will form packages of the identical size. If we use 
the utility ping for delay definition in it there is a special 
key for resizing of a testing package (— / in Windows, — s in 
Linux) . 

6. CONCLUSION 

In the present work for the description of process of the 
packet delay in a global networks it has been chosen expo- 
nential distribution. In comparison with truncated normal 
distribution it has shown the best correlation with experi- 
mental results. 

Experimental data were gathered by means of the precision 
RIPE measuring system to within microseconds, and also 
by means of the standard utility ping. This utility measures 
round-trip time to within milliseconds. During small periods 
about several minutes when it is possible to consider condi- 
tions of transmission on a TCP/IP network invariable, such 
approach gives correlations from above 0.99. At change of 
network conditions the elementary ping testing by a series 
from 10 packets will allow to change exponential distribution 
parameters instantly. 

In summary we would like to thank Leonid Fridmana, the 
professor from University of Mexico for fruitful dialogues in 
which course the idea of this article has taken shape. 

7. REFERENCES 

[1] Choi, B.-Y., Moon, S., Zhang, Z.-L., Papagiannaki, K. 
and Diot, C: Analysis of Point-To- Point Packet Delay 
In an Operational Network. In: Infocom 2004, Hong 
Kong, pp. 1797-1807 (2004) 

[2] Cottrell, L., Matthews, W. and Logg C: Tutorial on 
Internet Monitoring & PingER at SLAC. 
http://www.slac.stanford.edu/comp/net/wan- 
mon/tutorial.html 

[3] Crovella, M.E. and Carter, R.L.: Dynamic Server 
Selection in the Internet. In: Proc. of the Third IEEE 
Workshop on the Architecture and Implementation of 
High Performance Communication Subsystems (1995) 

[4] Dovrolis C, Ramanathan P., and Moore D., 
Packet-Dispersion Techniques and a 
Capacity-Estimation Methodology, IEEE/ ACM 
TRANSACTIONS ON NETWORKING, VOL. 12, 
NO. 6, DECEMBER 2004, p. 963-977 



[5] Downey A.B., Using Pathchar to estimate internet 
link characteristics, in Proc. ACM SICCOMM, Sept. 
1999, pp. 222-223. 

[6] Elteto, T., Molnar, S., On the distribution of 
round-trip delays in TCP/IP networks, in The 
Proceedings of the Local Computer Networks (LCN 
S99) Conference, IEEE, 1999, pp. 172-181 

[7] Georgatos, F., Gruber, F., Karrenberg, D., Santcroos, 
M., Susanj, A., Uijterwaal, H. and Wilhelm R., 
Providing active measurements as a regular service for 
ISP's. In: PAM2001 

[8] Georges J. -P., Divoux T., and Rondeau E., 

Confronting the performances of a switched ethernet 
network with industrial constraints by using the 
network calculus, International Journal of 
Communication Systems(IJCS), vol. 18, no. 9, pp. 
877-903, 2005 

[9] Fridman E., Seuret A., and Richard J.-P., "Robust 
sampled-data stabilization of linear systems: an input 
delay approach," Automatica, vol. 40, pp. 1441-1446, 
2004 

[10] Hespanha J. P., Naghshtabrizi P., and Xu Y., "A 

survey of recent results in networked control systems," 
Proceedings of the IEEE, vol. 95, pp. 138-162, January 
2007 

[11] D. Papagiannaki, S. Moon, C. Fraleigh, P. Thiran, F. 
Tobagi, and C. Diot, Analysis of measured single-hop 
delay from an operational backbone network, in Proc. 
IEEE INFOCOM 2002, New York, New York, June 
2002 

[12] A.M. Sukhov, T.G. Sultanov, M.V. Strizhov, A.P. 
Platonov, Throughput metrics and packet delay in 
TCP/IP networks, RIPE59 .Meeting, Lisbon, 2009: 
larXiv:0907.3710l 

[13] Ripe Test Box, http://ripe.net/projects/ttm/ 

[14] Y. Tipsuwan and M.-Y. Chow, "Control 

methodologies in networked control systems," Control 
Engineering Practice, vol. 11, pp. 1099-1111, 2003 

[15] Zampieri S., "Trends in networked control systems," 
Proceedings of the 1 7th World Congress, The 
International federation of Automatic Control, July 
2008 

[16] W. Zhang and M.S. Branicky and S.M. Phillips, 

Stability of Networked Control Systems, IEEE Control 
System Magazine, 21(l):84-99, February 2001 



